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INITIATING INSTANT MESSAGING (IM) CHAT SESSIONS 
FROM EMAIL MESSAGES 

CROSS REFERENCE TO RELATED APPLICATIONS 

5 This application is a continuation-in-part (CIP) of U.S. patent application serial 

number 10/326,479, filed on December 19, 2002, which claims the benefit of U.S. 
provisional patent application serial numbers 60/41 1,336, filed September 17, 2002; 
60/416,916, filed October 8, 2002; 60/419,613, filed October 17, 2002; '60/426,145, filed 
November 14, 2002; 60/426,146, filed November 14, 2002; 60/426,422, filed November 
10 14, 2002; 60/426,432, filed November 14, 2002; and 60/426,440, filed November 14, 
2002. 

This application is also a CEP of U.S. patent application serial number 10/274,405, 
filed October 18, 2002, which claims the benefit of U.S. provisional patent application 
serial numbers 60/41 1,336, filed September 17, 2002; and 60/419,613, filed on October 
15 17,2002. 

The above-referenced applications are incorporated herein by reference as if set 
forth in their entireties. 

FIELD OF DISCLOSURE 

20 The present disclosure relates generally to communications and, more particularly, 

to digital communications. 



BACKGROUND 

Instant messaging (IM) is a real-time based communications system, while email 

25 is more of a correspondence form of messaging. Upon receiving an email message, rather 

than replying to the listed recipients via email, a user may wish to expedite 
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communications by chatting via IM with the sender of the email or with other people 
(e.g., other contacts) addressed in the email message. 

In the past, vendors have offered an IM roster as a single pane in the main email 
window, thereby permitting a user to launch a separate IM client to chat with a contact 
that is listed on the IM roster. However, this type of environment provided nothing more 
than a single view of two separate clients (e.g., an email client and an IM client). 

In view of this deficiency, a heretofore-unaddressed need exists in the industry for 
greater integration between email and IM. 

SUMMARY 

The present disclosure provides for the initiation of instant messaging (IM) chat 
sessions from email messages. 

In one embodiment, among others, an email message is received, and an IM chat 
session is automatically initiated from the email message. In some embodiments, the 
initiation of the IM chat session may be subject to programmable criteria. 

Other systems, methods, features, and advantages will be or become apparent to 
one with skill in the art upon examination of the following drawings and detailed 
description. It is intended that all such additional systems, methods, features, and 
advantages be included within this description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Many aspects of the disclosure can be better understood with reference to the 
following drawings. The components in the drawings are not necessarily to scale, 
emphasis instead being placed upon clearly illustrating the principles of the present 
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disclosure. Moreover, in the drawings, like reference numerals designate corresponding 
parts throughout the several views. 

FIG. 1 is a block diagram showing one embodiment of component architecture for 
integrating instant messaging (IM) and email. 

FIGS. 2A through 2C are block diagrams showing one embodiment of component 
architecture related to email services. 

FIGS. 3 A through 3C are block diagrams showing one embodiment of component 
architecture related to IM services. 

FIGS. 4A through 4C are block diagrams showing instantiation of various email 
components in one embodiment of the system. 

FIG. 5 is a block diagram showing functionality of the read window of FIG. 4C. 

FIGS. 6A through 6C are block diagrams showing instantiation of various IM 
components in one embodiment of the system. 

FIG. 7 is a block diagram showing an overview of component architecture related 
to both IM and email services. 

FIG. 8 is a diagram showing one embodiment of the mail store of FIG. 7 in greater 

detail. 

FIG. 9 is a diagram showing one embodiment of a user interface for the message 
center of FIG. 7 in greater detail. 

FIG. 1 OA is a diagram showing one embodiment of a user interface for the read 
window of FIG. 7 in greater detail. 

FIG. 1 0B is a diagram showing one embodiment of an IM chat window launched 
from the email read window of FIG. 10A. 

FIG. 1 1 is a diagram showing one embodiment of the address book user interface 
of FIG. 7 in greater detail. 
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FIG. 12 is a diagram showing one embodiment of a user interface for adding new 
contact information. 

FIGS. 13A and 13B are diagrams showing one embodiment of the address book 
database of FIG. 7 in greater detail. 
5 FIG. 14 is a diagram showing one embodiment of the roster window of FIG. 7 in 

greater detail. 

FIG. 15 is a diagram showing one embodiment of the chat window of FIG. 7 in 
greater detail. 

FIG. 16 is a diagram showing a thread history database in accordance with one 
1 0 embodiment of the invention. 

FIG. 17 is a flowchart showing one embodiment of a method for integrating email 
and IM services in which IM Internet presence information is displayed on an email read 
window. 

FIGS. 18A and 18B are flowcharts showing embodiments of a method for 
1 5 integrating email and IM services in which an IM session may be initiated from an email 
read window. 

FIGS. 19 and 20 are flowcharts showing another embodiment of a method for 
integrating email and IM services in which IM sessions with multiple contacts is 
established at a single IM window. 
20 FIG. 21 is a flowchart showing another embodiment of a method for integrating 

email and IM services in which IM messages from two disparate IM services is bridged 
by the user's IM service. 

FIG. 22 is a flowchart showing, in greater detail, the reformatting of the EM 
message shown in FIG. 21. 
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FIG. 23 is a flowchart showing, in greater detail, the removing of the user IM 
address from the IM message as shown in FIG. 22. 

FIG. 24 is a flowchart showing one embodiment of a method for integrating email 
and IM services in which contact information is correlated to a contact identifier 
5 associated with a particular contact. 

FIG. 25 is a flowchart showing one embodiment of a method for integrating email 
and IM services in which an email thread history is stored in a single thread history 
database. 

FIG. 26 is a flowchart showing one embodiment of a method for integrating email 
10 and IM services in which an email thread history is stored in a single thread history 
database. 

FIG. 27 is a flowchart showing one embodiment of a method for integrating email 
and IM services in which an IM thread history is stored in a single thread history 
database. 

15 FIGS. 28A through 28C are data flow diagrams corresponding to FIGS. 2A 

through 2C. 

FIGS. 29A through 29D are data flow diagrams corresponding to FIGS. 3A 
through 3C. 

FIG. 30 is a block diagram showing one embodiment of an email user agent 
20 instantiating a plurality of post office protocol version 3 (POP3) transport protocol objects 
(TPOs). 

FIG. 31 is a block diagram showing one embodiment of an email user agent 
communicating with a plurality of email servers through the plurality of POP3 TPOs. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Reference is now made in detail to the description of the embodiments as 
illustrated in the drawings. While several embodiments are described in connection with 
these drawings, there is no intent to limit the invention to the embodiment or 
5 embodiments disclosed herein. On the contrary, the intent is to cover all alternatives, 
modifications, and equivalents. Additionally, while the following description and 
accompanying drawings specifically describe integration of instant messaging (IM) and 
email, it will be clear to one of ordinary skill in the art that the systems and methods 
presented herein may be extended to integrating other messaging protocols such as voice- 

10 over Internet protocol (VoIP), video conferencing, etc. 

FIG. 1 is a block diagram showing one embodiment of component architecture for 
integrating instant messaging (IM) and email. As shown in FIG. 1, one embodiment of a 
system for integrating IM and email comprises a tray manager 102, an IM user agent 104, 
an email user agent 106, an address book object 108, and an address book database 1 10. 

15 In an example embodiment, the various components 102, 104, 106, 108, 1 10 may be seen 
as software modules, which are launched by a user on a personal computer (not shown) or 
other programmable device (not shown). In another embodiment, the various 
components 102, 104, 106, 108, 110 may be seen as software objects in a distributed 
network (not shown), which are instantiated and destroyed by appropriate software 

20 commands. Since instantiation and destruction of objects in distributed networks is well 

known, further discussion of object instantiation and destruction is omitted. 

In one embodiment, the various components 102, 104, 106, 108, 110 of FIG. 1 are 

software modules on a user's personal computer (not shown). In this regard, the software 

modules are installed on a user's personal computer and, thereafter, are launched by the 

25 user. During installation of the software modules, the user is queried for the user's login 
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names and passwords for all of the user's email accounts and all of the user's IM accounts. 
The login names and passwords for the user's email and IM accounts are stored in a login 
database (not shown) for subsequent use by the software modules. 

Upon installation of the software modules onto the personal computer (not 
5 shown), a user launches the tray manager 102. The tray manager 102 generates 

commands to launch the IM user agent 104, the address book object 108, the email user 
agent 106, and the address book database 1 10 as background processes. In response to 
the generated commands, the various components 104, 106, 108, 110 are launched as 
background processes. The address book object 108 is coupled to the address book 
10 database 1 10 so that information may be stored to the address book database 1 10 by the 
address book object 108 or retrieved from the address book database 1 10 by the address 
book object 108. Information stored in the address book database 110 may include, for 

c 

example, names and email addresses of the user's email contacts, names and IM addresses 

of the user's IM contacts, phone numbers for the various email and IM contacts, mailing 
15 addresses for the various email and IM contacts, business addresses for the various email 

and IM contacts, etc. Examples of the address book database 1 10 are shown in greater 

detail with reference to FIGS. 13 A and 13B. 

The IM user agent 104 and the email user agent 106 are configured to 

communicate with the address book object 108. In this regard, the address book object 
20 108 functions as an interface between the IM user agent 104 and the email user agent 106. 

In a broader sense, the address book object 108 interfaces the entire EM system (not 

shown in FIG. 1) to the entire email system (not shown in FIG. 1), thereby providing 

integration between the email system and the IM system. 

The tray manager 102 is configured to track communications between with the IM 

25 user agent 104, the address book object 108, and the email user agent 106. In this regard, 
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the tray manager 102 receives commands from the IM user agent 104, the address book 
object 108, and the email user agent 106. Similarly, the tray manager 102 generates 
commands and directs the generated (or received) commands to the IM user agent 1 04, 
the address book object 108, and the email user agent 106. Thus, in a general sense, the 
5 tray manager 102 receives information (e.g., commands, requests, data, etc.) and directs 
the received information to the appropriate software module. The interplay between the 
various components 102, 104, 106, 108, 1 10 is described below in greater detail. 
However, it is worthwhile to note that the various launched components 102, 104, 106, 
108, 110 provide a mechanism by which integration between the IM system and the email 

10 system is achieved. 

In another embodiment, the various components 102, 104, 106, 108, 110 of FIG. 1 
are objects in a distributed network (not shown). In this regard, subsequent to installation 
of the software modules, when a user launches the tray manager 102, the tray manager 
102 instantiates the IM user agent 104, the address book object 108, the email user agent 

15 106, and the address book database 110 and runs these objects on the client system (not 
shown) as background processes. The address book object 108 is coupled to the address 
book database 1 10 so that information may be stored to the address book database 1 10 by 
the address book object 108 or retrieved from the address book database 1 10 by the 
address book object 108. The IM user agent 104 and the email user agent 106 

20 communicate with the address book object 108, thereby using the address book object 
108 as an interface between the IM user agent 104 and the email user agent 106. As 
described above, the various instantiated components 104, 106, 108, 110 provide a 
mechanism by which integration between the IM system and the email system is 
achieved. 
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In one embodiment, the address book database 1 10 may be located at a client 
machine (not shown) with a duplicate copy (not shown) stored at a server (not shown). In 
that embodiment, the copy of the address book database at the server may be updated by 
the address book database 1 10 at the client machine when a user logs into the server. 
5 Similarly, the copy of the address book database at the server may be updated by the 
address book database 1 10 at the client machine when the user logs out of the server. In 
this regard, a user may edit contents of the address book database 1 10 while the user is 
"offline," and the updated contents may be uploaded to the copy of the address book 
database at the server when the user logs into the server. 

10 Regardless of whether the various components 104, 106, 108, 110 are launched as 

software modules or instantiated as distributed objects, once the various components 104, 
106, 108, 1 10 are running as background processes, the tray manager 102 launches a user 
interface (not shown), which requests the user to select either an IM interface (not shown 
in FIG. 1) or an email interface (not shown in FIG. 1). FIGS. 2 A through 2C are block 

15 diagrams showing component architecture associated with the user selecting the email 

interface (not shown in FIG. 1), while FIGS. 3 A through 3C are block diagrams showing 
component architecture associated with the user selecting the IM interface (not shown in 
FIG. 1). 

FIGS. 2 A through 2C are block diagrams showing one embodiment of component 
20 architecture related to email services when the user selects the email user interface 210. 
As described above, the tray manager 102 queries the user for the selection of the IM or 
email interface. If the user selects the email interface, then the tray manager 102 receives 
the selection of the email user interface 210 and retrieves the login names and passwords, 
which were previously stored during installation of the software modules, from the login 
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database. The email login names and passwords are conveyed to the email user agent 
106, which receives the login names and passwords. 

Upon receiving the login names and passwords of all of the user's email accounts, 
the email user agent 106 logs into each of the user's email accounts at the various email 
5 servers 204 using the respective login names and passwords. Upon logging into each of 
the user's email accounts, the email user agent 106 retrieves all of the email messages 
stored on the email accounts and stores them at a local mail store 206. In an example 
embodiment, the user's email accounts are simple mail transfer protocol (SMTP) email 
accounts. Additionally, the user's email account may be post office protocol version 3 

10 (POP3) compatible. 

Since the logging into email accounts, retrieving email messages, and storing 
email messages at local mail stores is discussed in greater detail with reference to FIGS. 
30 and 31, further discussion of the logging into email accounts, retrieving email 
messages, and storing email messages is omitted here. However, it is worthwhile to note 

15 that the email user agent 106 and address book object 108 of FIG. 2 A permit the 

automatic retrieval of multiple email messages from multiple email accounts, and the 
storage of the retrieved email messages according to their respective originating email 
accounts. 

Upon retrieving multiple email messages from multiple email accounts and 

20 storing them at the mail store 206, the email user agent 106 generates a command to the 

tray manager 102 to launch or instantiate an email user interface 210 to display the 

retrieved email messages to the user. This is shown in greater detail in FIG. 2B. As 

shown in FIG. 2B, upon receiving the command to launch or instantiate the email user 

interface 210, the tray manager 102 instantiates the email user interface 210, which, in 

25 turn, instantiates a message center 212 for displaying the retrieved email messages. The 
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email user agent 106 retrieves the stored email messages from the mail store 206 and 
conveys the email messages to the tray manager 102. The tray manager 102 further 
conveys the email messages to the email user interface 210, which displays the email 
messages at the message center 212. Thus, at this point, all of the email messages from 
5 all of the user's email accounts are available to the user at the message center 212. In 
another embodiment, the message center 212 may be instantiated with a pointer to the 
mail store 206, thereby permitting direct retrieval of the email messages from the mail 
store 206 by the message center 212. 

In addition to logging into the various email accounts, the tray manager 102 
10 initiates a login to each of the user's IM accounts. This is shown in FIG. 2C. As 

described above with reference to FIG. 1, the tray manager 102 retrieves the login names 
and passwords. The tray manager 102 conveys the IM login names and passwords to the 
IM user agent 104. 

Upon receiving the login names and passwords of all of the user's IM accounts, 
1 5 the IM user agent 104 logs into each of the user's IM accounts through an IM abstraction 
server 304 using the respective login names and passwords. The logging into various IM 
accounts through the IM abstraction server 304 is described in detail in U.S. provisional 
patent application serial numbers 60/41 1,336 and 60/419,613, and U.S. patent application 
serial numbers 10/274,408, 10/274,478, and 10/274,405, which are incorporated herein by 
20 reference as if set forth in their entireties. Also, a similar login process is shown with 

reference to FIGS. 30 and 31 for email accounts. Thus, further discussion of logging into 
various IM accounts through the IM abstraction server 304 is omitted here. 

Upon logging into the various IM accounts, the IM user agent 104 obtains Internet 
presence information for all of the user's IM contacts as described in U.S. provisional 
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patent application serial numbers 60/41 1,336 and 60/419,613, and U.S. patent application 
serial numbers 10/274,408, 10/274,478, and 10/274,405. 

As seen from the component architecture of FIG. 1 and FIGS. 2 A through 2C, the 
launching of the tray manager 102 results in retrieval of all of the user's email messages 
5 and all of the contacts' IM Internet presence information. 

FIGS. 3A through 3C are block diagrams showing one embodiment of component 
architecture related to IM services when the user selects the IM interface 308. As 
described above, the tray manager 102 queries the user for a selection of the IM or email 
interface. If the user selects the IM interface, then the tray manager 102 instantiates the 
10 IM user interface 308, which queries the user for the user's EM login name and password. 
Thus, unlike the email login process, which automatically retrieves login names and 
passwords without further input from the user, the IM login process requires, in this 
embodiment, the input of a user login name and password. 

As shown in FIG. 3 A, the IM user agent 104 receives the login name and 
1 5 password and looks up the login database (not shown) to determine whether or not the 
login name and password are valid (i.e., whether or not the login name and password are 
located in the login database). If the login name and password are valid, then the IM user 
agent 104 retrieves login names and passwords for all of the user's IM accounts. 

Upon retrieving the login names and passwords of all of the user's IM accounts 

20 from the login database, the IM user agent 104 logs into each of the user's IM accounts 

through an IM abstraction server 304 using the respective login names and passwords for 

each of the user's IM accounts. The logging into various IM accounts through the IM 

abstraction server 304 is described in detail in U.S. provisional patent application serial 

numbers 60/41 1,336 and 60/419,613, and U.S. patent application serial numbers 

25 10/274,408, 10/274,478, and 10/274,405, which are incorporated herein by reference as if 
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set forth in their entireties. Also, similar processes related to email are described with 
reference to FIGS. 30 and 31. Thus, further discussion of logging into various IM 
accounts through the IM abstraction server 304 is omitted here. 

Upon logging into the various IM accounts, the IM user agent 104 obtains Internet 
5 presence information for all of the user's IM contacts as described in U.S. provisional 

patent application serial numbers 60/411,336 and 60/419,613, and U.S. patent application 
serial numbers 10/274,408, 10/274,478, and 10/274,405. 

Upon logging into the user's various EM accounts and retrieving the Internet 
presence information of the user's contacts, the IM user agent 104 generates a command 
10 to the tray manager 102 to display the retrieved IM information. This is shown in greater 
detail in FIG. 3B. As shown in FIG. 3B, upon receiving the command to display the 
retrieved IM information, the tray manager 102 requests the IM user interface 308 to 
instantiate a roster window 310 for displaying the user's contacts and the contacts' 
respective IM Internet presence information. The IM user agent 104 conveys the IM 
15 information having the contacts' names and the contacts' IM Internet presence information 
to the tray manager 102. The tray manager 102 further conveys the IM information to the 
IM user interface 104, which displays the IM contact names and their respective EM 
Internet presence information to the user at the roster window 310. Thus, at this point, all 
of the contacts and their respective EM Internet presence information is available to the 
20 user at the roster window 310. 

In addition to logging into the various EM accounts, the tray manager 102 initiates 

a login to each of the user's email accounts. As shown in FIG. 3C, the tray manager 102 

receives the login name and password from the EM user agent 1 04 and conveys the login 

name and password to the email user agent 106. The email user agent 106 receives the 

25 login name and password and looks up the login database (not shown) to determine 
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whether or not the login name and password are valid (i.e., whether or not the login name 
and password are located in the login database). If the login name and password are 
valid, then the email user agent 106 retrieves login names and passwords for all of the 
user's email accounts. 

5 Upon retrieving the login names and passwords of all of the user's email accounts 

from the address book database 110, the address book object 108 conveys the login 
names and passwords to the email user agent 106. The email user agent 106 logs into 
each of the user's email accounts at the various email servers 204 using the respective 
login names and passwords. Upon logging into each of the user's email accounts, the 

10 email user agent 106 retrieves all of the email messages stored on the email accounts and 
stores them at a local mail store 206. In an example embodiment, the user's email 
accounts are simple mail transfer protocol (SMTP) email accounts. Additionally, the 
user's email accounts may also be POP3 compatible. 

Since the logging into email accounts, retrieving email messages, and storing 

15 email messages at local mail stores is discussed in greater detail with reference to FIGS. 
30 and 31, further discussion of the logging into email accounts, retrieving email 
messages, and storing email messages is omitted here. However, it is worthwhile to note 
that the instantiating of an EM user interface results in the automatic retrieval and storage 
of all of the user's email messages and the storage of the retrieved email messages 

20 according to their originating email account. Additionally, as seen from the component 
architecture of FIG. 1 and FIGS. 3 A through 3C, the input of a single login name and 
password to the IM user agent 1 04 results in retrieval of all of the user's contacts' IM 
Internet presence information. Furthermore, as seen from FIGS. 1 through 3C, the 
address book object 108 and the address book database 1 10 provide an interface between 
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the IM user agent 104 and the email user agent 106, thereby providing integration of IM 
and email. 

FIGS. 4A through 4C are block diagrams showing instantiation of various email 
components in one embodiment of the system. While one embodiment of the message 
5 center 212 is shown in greater detail with reference to FIG. 9, a discussion of the 

functionality of the message center 212 is described below with reference to FIGS. 4A 
through 4C. As described with reference to FIGS. 2 A through 2C, upon receiving a 
single login name and password, the tray manager 102 automatically logs the user into all 
of the user f s IM accounts as well as all of the user's email accounts. 

10 One option that is provided to the user at the message center 212 is the option to 

edit entries in the address book database 1 10. This is shown in FIG. 4 A. If the user 
selects the option to edit the address book database 110, then the message center 2 1 2 
generates a request 442 to the email user interface 210 to generate an address book user 
interface 404. The email user interface 210 conveys the request 444 to the tray manager 

15 102, which receives the request and generates a command 446 to the email user interface 
210 to instantiate the address book user interface 404. The command 446 includes a 
pointer to the address book object 108, which eventually permits the address book user 
interface 404 to modify the address book database 110 through the address book object 
108. The email user interface 210, in response to the command 446 from the tray 

20 manager 102, instantiates the address book user interface 404 with direct access to the 
address book object 108. Since editing of address book databases are well known in the 
art, further discussion of editing address book databases is omitted here. However, it is 
worthwhile to note that, unlike prior systems, the address book user interface 404 permits 
a user to edit the address book database 1 10 by adding and removing both email and IM 
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contact information for contacts having various IM and email accounts (e.g., America 
On-Line (AOL), Microsoft Network (MSN), Yahoo, BellSouth, etc.). 

Another option that is provided to the user at the message center 212 is the option 
to compose a new email message to a contact. This is shown in FIG. 4B. If the user 
5 selects the option to compose a new email message, then the message center 212 

generates a request 452 to the email user interface 210 to generate a compose window 
408. The email user interface 210 conveys the request 454 to the tray manager 102, 
which receives the request and generates a command 456 to the email user interface 210 
to instantiate the compose window 408. The command 456 includes a pointer to the 

10 address book object 108, which eventually permits the compose window 408 to access the 
address book database 110 through the address book object 108, thereby permitting 
retrieval of email addresses of contacts. The email user interface 210, in response to the 
command 456 from the tray manager 102, instantiates the compose window 408 with 
direct access to the address book object 108. Since composing new messages is well 

1 5 known in the art, further discussion of composing new messages is omitted here. 

Yet another option that is provided to the user at the message center 212 is the 
option to read an email message from a contact. This is shown in FIG. 4C. In operation, 
all of the user's email messages are displayed to the user at the message center 212. Upon 
receiving a selection of one of the displayed email messages for reading by the user, the 

20 message center 212 generates a request 462 to the email user interface 210 to generate a 

read window 412. The request 462 includes information related to the selected email 

message, such as a globally-unique identifier (GUID) associated with the selected email 

message. The email user interface 210 conveys the request 464 to the tray manager 102, 

which receives the request 464 and generates a command 466 to the email user interface 

25 2 1 0 to instantiate the read window 412. The command 466 includes a pointer to the 
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address book object 108 and a pointer to the email user agent 106. The pointer to the 
address book object 108 eventually permits the read window 412 to access the address 
book database 1 10 through the address book object 108. This is shown in greater detail 
with reference to FIG. 5. The email user interface 210, in response to the command 466 
5 from the tray manager 102, instantiates the read window 412. Upon being instantiated, 
the read window 412 issues a request to the email user agent 106 to retrieve the selected 
email message. The email user agent 106 receives the request and retrieves the selected 
email message from the mail store 206. The retrieved email message is conveyed from 
the email user agent 106 to the read window 412 and displayed to the user at the read 

10 window 412. While reading of email messages is well known in the art, it is worthwhile 
to note that, unlike prior systems, the system of FIG. 4C permits a user to read email 
messages from any of the user's email accounts (e,g., a BellSouth email account, an AOL 
email account, a Yahoo email account, an MSN email account, etc.). 

FIG. 5 is a block diagram showing another aspect of the read window of FIG. 4C. 

15 While one embodiment of the read window 412 is shown in detail with reference to FIG; 
10A, the functionality of the read window 412 is described below with reference to FIG. 
5. As shown in FIG. 5, the read window 412 is instantiated by the email user interface 
21 0 so that the read window 412 has direct access to the address book object 108. In this 
regard, any information that is available to the address book object 108 may also be 

20 available to the read window 412. In operation, upon receiving the selected email 

message from the email user agent 106, the read window 412 extracts all of the email 

addresses in the email message. For example, the sender's email address is extracted from 

the email message. Similarly, if courtesy copies (cc) of the email message were sent to 

other recipients, then the email addresses of the other recipients are also extracted from 

25 the email message. Upon extracting all of the email addresses from the email message, 
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the read window 412 generates a request 502 to the address book object 108 for IM 
Internet presence information of the contacts at the extracted email addresses. In this 
regard, the request 502 includes the extracted email addresses. 

Upon receiving the request 502, the address book object 108 generates a query 
5 504 to the address book database 1 10 to request all IM addresses that are correlated to the 
extracted email addresses. If an extracted email address is not found in the address book 
database 110, then an error message is returned to the address book object 108 to indicate 
that no IM Internet presence information is available for that email address. Similarly, if 
an extracted email address is not correlated to any IM address, then an error message is 

10 returned to the address book object 108 to indicate that no IM Internet presence 

information is available for that email address. If, on the other hand, the extracted email 
address is found in the address book database 110, and the extracted email address is 
correlated to at least one IM address, then the IM address associated with the extracted 
email address is retrieved from the address book database 1 10 by the address book object 

15 108. This process is repeated for each of the extracted email addresses until either an 
error message or at least one IM address is returned for each of the extracted email 
addresses. 

If an error message is returned to the address book object 108 for an extracted 

email address, then the error message is conveyed by the address book object 108 to the 

20 read window 412, which displays to the user that no IM Internet presence information is 

available for that extracted email address. If, on the other hand, an IM address is 

returned, then the address book object 108 queries the IM user agent 104, using the IM 

address, for IM Internet presence information of the contact at the retrieved IM address. 

The IM user agent 104, already having the IM Internet presence information of all of the 

25 user's contacts (see FIGS. 2A through 3C), receives the query 508 and returns IM Internet 
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presence information for the retrieved IM address to the address book object 108. The IM 
Internet presence information 512 is then conveyed by the address book object 108 to the 
read window 412. The read window 412 subsequently displays the IM Internet presence 
information next to its respective email address, thereby providing the user with a 
5 contacts IM Internet presence information at the email read window 412. 

As seen from the embodiment of FIG. 5, by having the address book object 108 
interface the IM user agent 104, the address book database 110, and the email read 
window 412, the embodiment of FIG. 5 permits a user to determine IM Internet presence 
information directly from an email read window 412. Also, since IM is integrated with 

10 email, it is now possible to launch an IM chat session with an email contact directly from 
the read window 412. This is described in greater detail with reference to FIG. 10A. 

FIGS. 6 A through 6C are block diagrams showing instantiation of various IM 
components in one embodiment of the system. While the roster window 310 is shown in 
greater detail with reference to FIG. 14, the functionality of the roster window 310 is 

15 described with reference to FIGS. 6 A through 6C. As shown in FIG. 6 A, one option that 
is provided to the user at the roster window 310 is the option to edit entries in the address 
book database 110. If the user selects the option to edit the address book database 1 10, 
then the roster window 310 generates a request 604 to the IM user interface 308 to 
generate an address book user interface 404. The IM user interface 308 conveys the 

20 request 606 to the tray manager 102, which receives the request and generates a command 

608 to the IM user interface 308 to instantiate the address book user interface 404. The 

command 608 includes a pointer to the address book object 108, which eventually permits 

the address book user interface 404 to modify the address book database 1 10 through the 

address book object 108. The IM user interface 308, in response to the command 608 

25 from the tray manager 102, instantiates the address book user interface 404, which is 
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instantiated with direct access to the address book object 108. Since editing of address 
book databases are well known in the art, further discussion of editing address book 
databases is omitted here. However, it is worthwhile to note that, unlike prior systems, 
the address book user interface 404 permits a user to edit the address book database 1 10 
5 by adding and removing both email and IM contact information for contacts having 
various IM and email accounts (e.g., AOL, MSN, Yahoo, BellSouth, etc.). 

As shown in FIG. 6B, another option that is provided to the user at the roster 
window 3 10 is the option to transfer files to a contact. If the user selects the option to 
transfer a file, then the roster window 310 generates a request 642 to the email user 

10 interface 210 to generate a file transfer window 612. The email user interface 210 
conveys the request 644 to the tray manager 102, which receives the request and 
generates a command 646 to the email user interface 210 to instantiate the file transfer 
window 612. The command 646 includes a pointer to the address book object 108, which 
eventually permits the file transfer window 612 to access the address book database 110 

15 through the address book object 108, thereby permitting retrieval of email addresses and 
IM addresses of the contacts. The email user interface 210, in response to the command 
646 from the tray manager 102, instantiates the file transfer window 612 with direct 
access to the address book object 108. Since transferring files from IM roster windows is 
well known in the art, further discussion of transferring files from IM roster windows is 

20 omitted here. However, it is worthwhile to note that, unlike prior systems, the system of 
FIG. 6B permits file transfers to contacts at various EM services (e.g., AOL IM, MSN IM, 
Yahoo IM, BellSouth IM, etc.) and at various email services (e.g., AOL email, MSN 
email, Yahoo email, BellSouth email, etc.), regardless of the contacts' IM or email service 
provider. 
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As shown in FIG. 6C, yet another option that is provided to the user at the roster 
window 310 is the option to chat with a contact. In operation, all of the user's IM contacts 
and their respective IM Internet presence information are displayed to the user at the 
roster window 310. Upon receiving a selection of one of the IM contacts by the user, the 
5 roster window 310 generates a request 652 to the email user interface 210 to generate a 
chat window 614. The request 652 includes information related to the selected contact. 
The email user interface 210 conveys the request 654 to the tray manager 102, which 
receives the request 654 and generates a command 656 to the IM user interface 308 to 
instantiate the chat window 614. The command 656 includes a pointer to the IM user 

10 agent 104. The IM user interface 308, in response to the command 656 from the tray 
manager 102, instantiates the chat window 614. Upon being instantiated, the chat 
window 614 issues a request to the IM user agent 104 to establish a chat session with the 
selected contact. Since the initiation of chat sessions at chat windows is well known in 
the art, further discussion of initiating chat sessions at chat windows is omitted. 

15 However, it is worthwhile to note that, unlike prior systems, the system of FIG. 6C 
permits a user to initiate a chat session and engage in a chat session with any of the 
contacts regardless of the contacts' IM account (e.g., BellSouth IM account, AOL IM 
account, Yahoo IM account, MSN IM account, etc.). Greater details related to IM 
chatting with various contacts at various IM accounts may be found in U.S. provisional 

20 patent application serial numbers 60/41 1,336 and 60/419,613, and U.S. patent application 

serial numbers 10/274,408, 10/274,478, and 10/274,405, which are incorporated herein by 

reference in their entireties. 

As seen from the embodiments of FIGS. 6A through 6C, by having the address 

book object 108 interface the IM user agent 104, the address book database 110, and the 

25 email user agent 106, greater integration between IM and email is provided. 
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FIG. 7 is a block diagram showing an overview of component architecture related 
to both IM and email services. Since the various components have been described in 
detail with reference to FIGS. 1, 2 A through 2C, 3 A through 3C, 4A through 4C, 5, and 
6A through 6C, only a truncated discussion of each of the IM and email components is 
5 presented here. As shown in FIG. 7, the address book object 108, the address book 

database 110, the address book user interface 404, and the tray manager 102 provide an 
interface between the various email components 106, 204, 206, 210, 21 2, 412, 408 and 
the various IM components 104, 304, 308, 310, 614, 612. In other words, integration of 
email and IM may be achieved by having a central address book database 110 that is 

10 accessible through an address book object 108 to both the various IM components 104, 
304, 308, 310, 614, 612 and the various email components 106, 204, 206, 210, 212, 412, 
408. The mechanism for sorting the various email messages into their respective folders 
is shown with reference to FIGS. 30 and 31 . 

FIG. 8 is a diagram showing one embodiment of the mail store 206 of FIG. 7 in 

15 greater detail. As shown in FIG. 8, the mail store 206 comprises several folders such as, 
for example, an inbox folder 810, a pending email folder 820, a sent items folder 830, a 
saved items folder 840, and a drafts folder 850. As described with reference to FIGS. 1 
through 3C, email messages from all of the user's email accounts are retrieved and stored 
at the mail store 206. The inbox folder 810 stores all of the received email messages from 

20 the various email accounts. Thus, for example, if a user has an AOL email account, an 

MSN email account, and a Yahoo email account, then the received email messages are 

retrieved from these various accounts and stored at the mail store 206. In an example 

embodiment, all of the email messages that are retrieved from the user's AOL email 

account are stored in an AOL folder 860; all of the email messages that are retrieved from 

25 the user's MSN account are stored in an MSN folder 870; and all of the email messages 

Page 23 



TKHR 190250-1590 
BellSouth® 030456 



that are retrieved from the user's Yahoo account are stored in a Yahoo folder 880. 
Similarly, any pending email, sent item, saved item, or drafts of emails may be saved in 
similar sub-folders (not shown) in their respective folders 820, 830, 840, 850. 

In another embodiment, if the user receives an email message from an AOL 
5 contact, then the system 202 (FIG. 2A) is configured so that any reply to that AOL 
contact is directed through the user's AOL account. Similarly, if the user receives an 
email message from an MSN contact, then the system is configured so that any reply to 
that MSN contact is directed through the user's MSN account. Thus, for example, if an 
email message 862 from Larry@AOL.com is retrieved from the user's AOL email 

10 account, then any reply to that email from the user will be, by default, directed through 
the user's AOL email account. Thus, when Larry@AOL.com receives a reply from the 
user, the reply will appear to Larry@AOL.com as if it was sent from the user's AOL 
email account. Similarly, if an email message 874 from JAdams@MSN.com is retrieved 
from the user's MSN email account, then any reply to that email from the user will be, by 

15 default, directed through the user's MSN email account. Thus, when JAdams@MSN.com 
receives a reply from the user, the reply will appear to JAdams@MSN.com as if it was 
sent from the user's MSN email account. In another embodiment, the user may override 
the default settings and select a different mail server through which to send an email 
message. This process is described in greater detail with reference to FIGS. 30 and 3 1 . 

20 The mail store 206 of FIG. 8, unlike prior systems, comprises email messages 

from various email accounts (e.g., AOL, MSN, Yahoo), which are now accessible to the 
user through a single consolidated mail store 206. This permits the user to access all of 
the user's emails from all of the user's various email accounts without the inconvenience 
of having to manually access multiple separate email accounts. 
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FIG. 9 is a diagram showing one embodiment of a user interface 935 for the 
message center 212 of FIG. 7 in greater detail. As shown in FIG. 9, the user interface 935 
comprises a get mail (or read) selection button 910, a write (or compose) selection button 
915, an options selection button 920, and an address book database selection button 925. 
5 If a user selects the address book database selection button 925, then an address book user 
interface 404 is launched or instantiated as described with reference to FIG. 4A. If the 
user selects the write (or compose) selection button 915, then a compose window 408 is 
launched or instantiated as described with reference to FIG. 4B. Similarly, if the user 
selects the get mail (or read) selection button 910, then a read window 412 is launched or 
10 instantiated as described with reference to FIG. 4C. 

In addition to the selection buttons 910, 915, 920, 925, the message center 212 
includes a display screen 945, which displays received email messages and displays a 
preview pane having a preview of a selected email message. The display screen 945 also 
includes message response options such as replying to the email, forwarding the email, 
1 5 reading the full email (rather than merely previewing the email in the preview pane), 

deleting the email, or printing the email: Also, the message center 212 includes a folder 
list having a plurality of folders 901a, 901b, 901c, 920, which have various email 
messages that are organized in similar fashion to the mail store 206 of FIG. 8. Thus, for 
example, the folders may be organized according to the user's various email accounts 
20 (e.g., MSN, AOL, Yahoo, etc.), and each of these folders may be further organized into 
sub-folders such as, for example, inbox sub-folders 902, saved items sub-folders 903, 
drafts sub-folders 904, pending items sub-folders 905, etc. 

In an example embodiment, the user may organize the various folders and sub- 
folders according the user's particular needs or desires. Since the organization and 

25 display of folders is well known in the art, further discussion of organization and display 
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of folders is omitted here. However, it is worthwhile to note that, unlike prior systems, 
the message center 212 of FIG. 9 permits a user to view a listing of all of the user's email 
messages from all of the user's email accounts at a single central location. Thus, the 
message center 212 removes the inconvenience of manually accessing multiple email 
5 accounts to retrieve all of the user's email messages. 

FIG. 1 OA is a diagram showing one embodiment of a user interface 1055 for the 
read window 412 of FIG. 7 in greater detail. As shown in FIG. 1 OA, one embodiment of 
the read window 412 comprises several selection options that a user may select. For 
example, a user may select an email reply button 1042, an email forward button 1044, a 

10 print button 1046, a delete button 1048, or an IM start button 1050 from the email read 
window 412. If the user selects the email reply button 1042 or the email forward button 
1044, then an email compose window 408 is launched or instantiated as described with 
reference to FIG. 4B. If the user selects the print button 1046, then the email is printed to 
a local or network printer (not shown). If the user selects the delete button 1048, then the 

15 email message is deleted. Since these functions are well known in the art, further 

discussion of email reply, email forward, print, and delete functions are omitted here. 
However, it is worthwhile to note that, unlike prior systems, the selection of the reply 
button 1042, in one embodiment, permits the user to reply to the email message using the 
particular email account through which the email message was received. Thus, for 

20 example, if the email message is received through the user's BellSouth email account, 

then the reply to the email would be transmitted through the user's BellSouth email 

account. This is discussed in greater detail with reference to FIGS. 30 and 31. 

In addition to the conventional selection buttons 1042, 1044, 1046, 1048, the read 

window 412 comprises an IM start button 1050. The IM start button 1050 permits a user 

25 to launch an IM session with various contacts from the read window 412. As described 
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with reference to FIG. 5, the read window 412 provides 1M Internet presence information 
for each of the email addresses shown on the read window 412. Thus, for example, if a 
user receives an email message from Larry@yahoo.com, and the email message is cc f d to 
Moe@AOL.com, Shemp@hotmail.com, and contactl@MSN.com, then an IM Internet 
5 presence indication is displayed by each of the email addresses. Thus, for the contacts 
shown in FIG. 10A, the email address and at least one corresponding IM address was 
found in the user's address book database 1 10 for Larry@Yahoo.com, Moe@AOL.com, 
andcontactl@MSN.com. Conversely, either the email address or a corresponding IM 
address was not found for Shemp@hotmail.com. Additionally, as shown in FIG. 10A, 

10 the retrieved IM Internet presence information for Larry@Yahoo.com, Moe@AOL.com, 
and contact 1 @MSN.com indicated that Larry@Yahoo.com was present while 
Moe@AOL.com and contactl@MSN.com were not present. 

Thus, as shown in the read window 412, an icon 1062 is displayed next to 
Larry@Yahoo.com to indicate that Larry@Yahoo.com is present; a different icon 1064 is 

15 displayed next to Moe@AOL.com and contactl@MSN.com to indicate that 

Moe@AOL.com and contactl@MSN.com are not present; and no icon is displayed next 
to Shemp@hotmail.com to indicate that no IM Internet presence information could be 
obtained for Shemp@hotmail.com. As shown in FIG. 10A, the read window 412 displays 
the IM Internet presence information for all of the email addresses shown in the email 

20 message. 

Since it is indicated that Larry@Yahoo.com is present, if the user selects 

Larry@Yahoo.com and selects the IM start button 1050, then an IM session with 

Larry@AOL.com is launched from the user's read window 412. On the other hand, if the 

user selects Moe@AOL.com, Shemp@hotmail.com, or contactl@MSN.com and selects 

25 the IM start button 1050, then an error message is displayed to the user to indicate that the 
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selected contacts are either not present, or that no IM session may be initiated with the 
selected contacts {e.g., no email address found in the address book database 1 10, or no 
corresponding IM address found in the address book database 110). 

If a contact is present, and the user has selected to initiate an IM session with the 
contact, then the read window 412 generates a request to the address book object 108 to 
initiate an IM session with the selected contact. The address book object 108 receives the 
request and forwards the request to the IM user agent 104. The IM user agent 104 
receives the request and instantiates an IM session between the user and the selected 
contact. In this regard, the IM user agent 104 issues an IM session invitation to the 
selected contact, and awaits an IM session acceptance of the IM session invitation. Upon 
receiving the IM session acceptance, the IM session is established. Since the initiation of 
IM sessions is described in detail in U.S. provisional patent application serial numbers 
60/41 1,336 and 60/419,613, and U.S. patent application serial numbers 10/274,408, 
10/274,478, and 10/274,405, further discussion of IM session instantiation is omitted 
here. However, it is worthwhile to note that, unlike prior systems, the read window 412 
of FIG. 10A permits a user to directly launch or initiate an IM session with a contact from 
the read window 412, thereby providing greater integration between email and IM. 

As shown with reference to FIG. 10A, the read window 412 displays to the user a 

received email message from a contact having IM Internet presence information related to 

that contact. Similarly, the read window 412 displays to the user the IM Internet presence 

information related to any other contact that may have been cc'd on the displayed email 

message. Furthermore, if it is indicated that the contact is present, then the read window 

412 permits a user to launch or initiate an IM session with the contact. Thus, by 

providing IM Internet presence information and the ability to initiate an IM session, the 

email read window 412 of FIG. 10A provides for greater IM and email integration. In 
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another embodiment, the EM Internet presence information and the launching of the IM 
session may be available to the user at the preview pane of FIG. 9. 

In other embodiments, the system may be configured to automatically initiate an 
EM chat session from an email message, rather than waiting for a manual input from a 
5 user. For example, when a user receives an email message from a contact, and the user 
views the email message in a read window or in a preview pane, if the contact is currently 
present online, then an IM chat session may be initiated automatically between the user 
and the contact. One embodiment of a process for automatically launching an IM chat 
session is shown in FIG. 18B. For the contacts shown in FIG. 10A, since the retrieved 

10 EM Internet presence information indicates that Larry@Yahoo.com is present, an EM chat 
session may automatically be initiated between the user and Larry@Yahoo.com. 

In some embodiments, the system may be configured to include the content or 
subject of the email message as part of the IM chat session to apprise the user or the 
sender or both that the IM chat session is being established in connection with the email 

15 message. For those embodiments, the content or subject of the email message may be 
included in a dialogue box that is separately displayed to the user from the EM chat 
messages. Alternatively, the content or subject of the email message may be included in 
the text portion of the EM chat messages so that both the user and the contact may see the 
content or subject of the email message. One such embodiment of the IM chat window is 

20 shown in FIG. 10B. As shown in FIG. 10B, the EM chat window includes the text of the 

email message from FIG. 10A, thereby apprising the user that the EM chat window has 

been launched in response to the email message. 

In some embodiments, the automatic launching of the IM chat session from the 

email message may be selectively activated or deactivated as an option. Thus, for 

25 example, if the automatic-launch option is activated, then IM chat sessions may be 
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launched without user intervention for those contacts on the email message who are 
present. Conversely, if the automatic-launch option is deactivated, then the user may 
manually launch IM chat sessions from the email message, as described above. The 
option to activate or deactivate the automatic launching of IM chat sessions from email 
5 messages may be provided to a user in an options menu or options button 920 at the IM 
user interface. Since setting of options in IM user interfaces is known in the art, further 
discussion of setting options is omitted here. 

In other embodiments, the launching of the IM chat session may be subject to 
additional criteria. For example, the system may be configured so that DM chat sessions 

10 are automatically established with the sender of the email message, but not for those 

individuals who are merely cc'd on the email message. In other embodiments, the system 
may be configured to automatically establish a joint chat session with all individuals on 
the email message, who are also present online. Also, the system may be configured so 
that IM chat sessions are automatically established only for designated individuals, such 

1 5 as those provided by the user at an interface similar to FIG. 12. For example, for the 

contacts shown in FIG. 10A, the system may be configured to automatically establish an 
IM chat session with Larry@Yahoo.com ifLarry@Yahoo.com is present, but may require 
manual initiation of IM chat sessions for Moe@AOL.com and contactl@MSN.com, if 
Moe@AOL.com and contactl@MSN.com are not set up for automatic-launching of IM 

20 from email. 

It should be appreciated that other additional criteria may be programmed into the 

system to permit various permutations of the above-described options. Moreover, 

additional criteria may be programmed into the system to permit automatic launching of 

IM chat sessions upon the occurrence of other triggering events. Non-limiting examples 

25 of such triggering events are described in co-pending U.S. patent application entitled 
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"PROCESSING RULES FOR DIGITAL MESSAGES," Attorney Docket No. 190250- 
1580 (BellSouth® 030455), filed on October 14, 2003, which is incorporated herein by 
reference in its entirety. 

In operation, if a contact listed on the email message is present, then the system 
5 generates a request to the address book object 108 to initiate an IM session with the 

present contact. In addition to the request, the system may provide the content or subject 
of the email message to the address book object 108. The address book object 108 
receives the request and any other provided information and forwards the request and the 
other information to the IM user agent 104. The IM user agent 104 receives the request 

10 and instantiates an IM session between the user and the present contact. In this regard, 

the IM user agent 104 issues an IM session invitation to the present contact, and awaits an 
IM session acceptance of the IM session invitation. Upon receiving the IM session 
acceptance, the IM user agent 104, in some embodiments, generates an IM chat window 
and includes the additional information, such as the content or subject of the email 

15 message, in the IM chat window. In other embodiments, the IM user agent 104 generates 
the IM chat window with the additional information prior to receiving the IM session 
acceptance. The additional information, in some embodiments, is shown only to the 
recipient. In other embodiments, the additional information may be displayed to both the 
recipient and the sender. In some embodiments, the user may optionally disable the 

20 displaying of additional information. Since the setting of options is known in the art, 
further discussion of option setting is omitted here. The additional information may 
indicate to the user or the contact or both that the IM chat session is being established in 
connection with the email message. The IM chat window is displayed to the user and an 
IM chat session is established between the user and the contact. As described above, the 



Page 3 1 



TKHR 190250-1590 
BellSouth® 030456 

automatic initiation of the IM chat session may be subject to additional criteria that may 
be programmed into the system. 

Since the initiation of IM sessions is described in detail in U.S. provisional patent 
application serial numbers 60/41 1,336 and 60/419,613, and U.S. patent application serial 
5 numbers 10/274,408, 10/274,478, and 10/274,405, further discussion of IM session 

instantiation is omitted here. However, it is worthwhile to note that, unlike prior systems, 
IM chat sessions are automatically launched or initiated, thereby providing greater IM 
functionality. 

FIG. 1 1 is a diagram showing one embodiment of the address book user interface 
10 404 of FIG. 7 in greater detail. As shown in FIG. 11, the address book user interface 404 
comprises a list of contacts 1110. In an example embodiment, the list of contacts 
comprises the first and last names of the contacts. If the contact has an email address 
1115, then this email address 1 115 is listed beside its respective contact 1110. Additional 
details 1 120 are also available for each contact 1110. In addition to having the list of 
15 contacts 1110, the list of email addresses 1115, and corresponding detailed information 
1 120 for the contacts, the address book user interface 404 also comprises a write (or 
compose) selection button 1 125, a new contact selection button 1 130, an new email list 
selection button 1 135, a delete selection button 1 140, an edit selection button 1 145, and a 
cancel selection button 1 150. 
20 The write (or compose) selection button 1 125 permits the user to compose an 

email message to a selected contact. Thus, in operation, if the user selects a contact from 
the list of contacts 1110 and selects the write (or compose) selection button 1 125, then the 
address book user interface 404 issues a request to the address book object 108 to launch 
or instantiate a compose window 408. Since the launching or instantiating of the 
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compose window 408 is described with reference to FIG. 4B, further discussion of 
launching or instantiating the compose window 408 is omitted here. 

The new contact selection button 1 130 permits the user to add new contact 
information to the address book database 1 10. Thus, in operation, if the user selects the 
5 new contact selection button 1 130, the address book user interface 404 issues a request to 
the address book object 108 to launch or instantiate a user interface for adding new 
contact information. The user interface for adding new contact information is discussed 
in greater detail with reference to FIG. 12. Similarly, the selection of the new email list 
selection button 1 135 launches or instantiates a user interface for creating a new email 
10 list. 

If the user selects a contact or a group of contacts from the list of contacts 1110 
and selects the delete selection button 1 140, then the delete selection is conveyed from 
the address book user interface 404 to the address book object 108. Upon receiving the 
delete selection, the address book object 108 deletes the selected contact or group of 

15 contacts from the address book database 110. 

The edit selection button 1 145 is similar to the new contact selection button 1 130 
in that a user interface for editing a contact is launched or instantiated in response to the 
selection of the edit selection button 1 145. Thus, in operation, if a user selects a contact 
or a group of contacts from the list of contacts 1110 and selects the edit selection button, 

20 then the address book user interface 404 issues a request to the address book object 108 to 
retrieve information related to the contact or the group of contacts from the address book 
database 110. Upon retrieving the information, the address book object 108 launches or 
instantiates an edit window (not shown) having the contact information, thereby 
permitting the user to edit the information. Once the information has been edited, the 
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address book user interface 404 conveys the changes to the address book object 108, 
which stores the changes in the address book database 110. 

The cancel selection button 1 150 closes the address book user interface 404. 

As shown with reference to FIG. 1 1, the address book user interface 404 permits a 
5 user to add new contact information arid edit presently existing contact information. 

Since adding new contact information and editing contact information are well known in 
the art, further discussion of adding new contact information and editing new contact 
information is omitted here. However, it is worthwhile to note that, unlike prior systems, 
the address book user interface 404 permits the user to add and edit information related to 
10 both email and EM from a single address book user interface 404. 

FIG. 12 is a diagram showing one embodiment of a user interface 1235 for adding 
new contact information. As shown in FIG. 12, the user interface 1235 comprises a name 
input box 1260, which permits a user to input a name of a contact. In addition to the 
name input box 1260, the user interface 1235 comprises an email address input box 1265, 
15 which permits a user to input one or more email addresses associated with the contact. 

The user interface 1235 further comprises an email list input box 1270, which permits the 
user to place the contact in a specified email list created by the user. Similarly, the user 
interface 1235 comprises an IM address input box 1280, which permits the user to input 
one or more EM addresses associated with the contact. In an example embodiment, the 
20 email addresses and IM addresses are sorted according to priority. The priority sorting of 
IM addresses and email addresses is shown in greater detail with reference to FIGS. 13 A 
and 13B. 

Likewise, street addresses, phone numbers, and other detailed information may be 

entered at the user interface 1235 at the address input box 1285, the phone number input 

25 box 1275, and the description input box 1290, respectively. Once the user has entered 
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information related to the contact into their respective boxes 1260, 1265, 1270, 1275, 
1280, 1285, 1290, the user interface 1235 conveys the information to the address book 
object 108, which stores the information in. the address book database 110. 

FIGS. 13A and 13B are diagrams showing one embodiment of the address book 
5 database 110 of FIG. 7 in greater detail. As described with reference to FIG. 10A, once 
information associated with a contact has been entered by the user, this information is 
stored in the address book database 110. As described with reference to FIGS. 1 through 
3C, the address book database 1 10 is one component through which email and IM 
integration is achieved. 
10 The address book database 110 comprises entries that are sorted according to 

contact identifiers 1310. In one embodiment, the contact identifier 1310 is an 
identification number that is unique to each contact. Thus, no two contacts share the 
same contact identifier 1310. In another embodiment, the contact identifier 1310 is the 
name of the contact. 

15 In any event, every piece of information related to a specific contact is correlated 

to the contact identifier 1310, thereby permitting a lookup of information based on the 
contact identifier 1310. Thus, as shown in FIGS. 13A and 13B, if an email address for a 
contact is entered as described with reference to FIG; 12, then this email address 1320 is 
stored in the address book database 1 10 so that it is correlated to the contact identifier 

20 13 10 for that contact. Similarly, if an IM address 1330, 1340, 1350 is entered for the 

contact, then the EM address 1330, 1340, 1350 is stored in the address book database 110 
so that it is correlated to the contact identifier 1310 for that contact. Phone numbers 
1340, fax numbers 1350, etc. are similarly stored in the address book database 1 10. Thus, 
the address book object 108 may determine any information associated with a particular 
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contact by accessing the address book database 1 10 and looking up the contact identifier 
1310 of the contact. 

For example, in operation, if the address book object 108 is provided an email 
address, as described with reference to FIG. 5, the address book object 108 may access 
5 the address book database 110 using the email address to determine a corresponding 

contact identifier 1310 for that email address. Once the corresponding contact identifier 
1310 is determined, the address book object 108 may retrieve the IM address of the 
contact from the address book object 108 using the contact identifier 1310. Thus, as 
described with reference to FIG. 5, if the email address corresponds to one or more IM 

10 addresses, then these IM addresses may be returned to the address book object 108, 
thereby permitting the address book object 108 to query the IM user agent 104 for IM 
Internet presence information associated with the contact identifier. 

In an example embodiment, the IM addresses 1330, 1340, 1350 are stored in order 
of priority. In other words, if a user prefers to engage in an IM session with a contact at a 

15 particular IM address (e.g., Yahoo IM address, AOL IM address, MSN IM address, 
BellSouth IM address, etc.), then the particular IM address is stored as the first IM 
address 1330. Similarly, if the contact has multiple IM addresses, then the user may 
arrange each IM address in the order of the user's preference. Thus, in operation, if a user 
launches an IM session with a contact from the read window 412, as described with 

20 reference to FIGS. 5 and 9, then the address book object 108 issues an IM session 

invitation to the first IM address 1330 stored in the address book database 1 10. If the 

contact is not present at the first IM address 1330, then the address book object 108 issues 

an IM session invitation to the second IM address 1340. The address book object 108 

continues in a "round-robin" fashion until an IM session acceptance is received from one 

25 of the IM addresses. Since the address book object 108 issues invitations in order of 
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priority as stored in the address book database 1 10, an IM session will be established 
using a higher priority IM address or a more preferred IM address before being 
established using a lower priority IM address. 

FIG. 14 is a diagram showing one embodiment of the roster window 310 of FIG. 7 
5 in greater detail. As shown in FIG. 7, the roster window 310 comprises a list of contacts 
1404, which may be sub-divided according to their respective IM accounts. Thus, for 
example, if the user's contacts have MSN IM accounts and AOL IM accounts, then the 
contacts having MSN accounts 1405 are grouped together while the contacts having AOL 
accounts 1407 are grouped together. Since the roster window 310 is described in detail in 

10 U.S. provisional patent application serial numbers 60/41 1,336 and 60/419,613, and U.S. 
patent application serial numbers 10/274,408, 10/274,478, and 10/274,405, further 
discussion of the roster window 310 is omitted here. However, it is worthwhile to note 
that, unlike prior systems, the roster window 310 of FIG. 14 permits a user to initiate an 
IM session with contacts at various IM addresses without manually logging into multiple 

1 5 IM accounts. 

FIG. 15 is a diagram showing one embodiment of the chat window 614 of FIG. 7 
in greater detail. As shown in FIG. 15, the chat window 614 comprises a transcript 
display window 1530, a user input window 1540, a first roster window 1555, and a 
second roster window 1565. The transcript display window 1530 displays IM messages 
20 that are typed by all of the participants in the IM chat session. Thus, if Larry, Curly, 

Moe, Shemp, and the user are engaged in an IM chat session, then each of the messages 
typed by the participants is displayed in the transcript display window 1530. The user 
input window 1540 displays the IM messages that are being typed by the user. 

The first roster window 1555 shows all of the contacts that are currently chatting 

25 in the chat window 614, while the second roster window 1565 displays all of the contacts 
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that are present on the Internet but not chatting in the chat window 614. If the user 
chooses to invite a contact from the second roster window 1565 to the current chat 
session in the chat window 614, then the user may select the contact from the second 
roster window 1565 and "drag and drop" that contact into the first roster window 1555, 
5 thereby effectively inviting that contact into the current chat session. Similarly, if the 

user wishes to remove a currently chatting contact from the IM chat session, then the user 
may "drag and drop" that contact from the first roster window 1 555 to the second roster 
window 1565. Thus, as shown with reference to FIG. 15, each of the participants of the 
IM session may invite or remove participants from the current IM chat session by moving 

10 the contacts from one roster window to the other roster window. 

Although chatting between multiple participants from a common IM service is 
known in the art, the embodiment of FIG. 15 permits chatting between multiple 
participants from different IM services. Thus, for example, Larry (in FIG. 15) may be 
using a Yahoo IM service, while Curly is using an AOL IM service, while Moe and 

1 5 Shemp may each be using an MSN IM service. 

In operation, when the user types an IM message at the user input window 1540, 
the typed message is translated into the native protocol associated with each of the other 
participants* IM services. Thus, any message typed by the user is displayed to each of the 
other participants in the IM chat session. Similarly, when the other participants type 

20 messages from their native IM windows, these messages are translated from the native 

protocols to an abstraction protocol, and the translated messages are displayed to the user 

at the IM chat window 614. Since translations to and from native protocols is described 

in detail in U.S. provisional patent application serial numbers 60/41 1,336 and 60/419,613, 

and U.S. patent application serial numbers 10/274,408, 10/274,478, and 10/274,405, 

25 further discussion of translations into native protocols is omitted here. 
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Additionally, one embodiment of the system of FIG. 15 provides a mechanism by 
which the other participants from the various other IM services may also engage in the 
IM session with the other participants. In other words, even if Larry only has a Yahoo IM 
account and Moe only has an MSN account, it is possible for Larry to engage in an IM 
5 chat session with Moe through the user's IM chat window 614. 

In this regard, the system of FIG. 15 is configured so that when Larry sends an IM 
message to the user, the message is received by the user's system, reformatted for Moe's 
IM service, and conveyed to Moe. Ordinarily, if the user's system merely conveys the 
message to Moe, then Moe will see that the message originates from the user, rather than 
10 from Larry. Thus, in order to seamlessly provide Moe with Larry's IM message, the 
user's system removes the user's information for all of Larry's IM messages, and 
substitutes Larry's information in place of the user's information. In this regard, when 
Moe receives an IM message from Larry through the user's IM account, the message will 
appear as if it were directly sent to Moe, rather than being cascaded through the user's IM 
1 5 account. 

In one embodiment, the user's IM address is removed from the IM message by 

inserting an appropriate number of delete characters into the text stream adjacent to the 

user's IM address. Thus, for example, if the user's IM address is ten characters in length, 

then, by inserting ten delete characters adjacent to the user's IM address, the user's IM 

20 address will be deleted from the text stream. Similarly, if the user's IM address is 25 

characters, then the insertion of 25 delete characters effectively removes the user's IM 

address from the forwarded text stream. Thus, regardless of the originator of the IM 

message, the user's system may remove the user's information from the IM message prior 

to forwarding the IM message to the other IM participants, thereby seamlessly interfacing 

25 the various IM services to one another through the user's IM account. 
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As described with reference to FIG. 15, one embodiment of the system provides 
for an IM session with multiple participants from multiple different IM services. Thus, in 
addition to seamlessly integrating email and EM, one embodiment of the system permits 
seamless integration of IM services across multiple different IM platforms. 
5 FIG. 16 is a diagram showing a thread history database 1610 in accordance with 

another embodiment of the invention. As described with reference to FIGS. 5 and 10A, a 
user may launch an IM session directly from an email read window 412. Thus, unlike 
prior systems, an email message may be threaded to an IM chat session. In this regard, 
when an IM chat session is launched from an email read window, the IM chat session is 

10 tagged with a pointer to the email message. 

Similarly, a participant in a chat session may email another participant in the chat 
session, thereby threading an email message to a chat session. In this regard, when an 
email message is launched from an IM chat session, the email message is tagged with a 
pointer to the IM chat session. In order to track threads across IM and email, a thread 

15 history database 1610 is maintained. For simplicity, the email message or IM session 
from which a subsequent email message or IM session is launched is referred to as the 
"parent," and the email message or IM session that is launched from the parent is referred 
to as the "child." 

In operation, when a child email message is generated from a parent IM chat 

20 window 614 (or a parent compose window 408), a globally unique identifier (GUED) is 

generated along with the child email message. Similarly, for each reply or forwarded 

email message, a GUID is generated. A pointer to the generated GUID is also created in 

the parent IM chat window, thereby linking the parent IM chat session to the child email 

message. Similarly, a pointer to the GUID of the parent IM chat session is created in the 

25 child email message, thereby linking the child email message to the parent EM chat 
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session. In an example embodiment, the GUID is a 128-bit number that is unique to that 
message. Since GUID generation is well known in the art, further discussion of GUID 
generation is omitted here. 

Likewise, when an EM chat session is established (see FIG. 6C), a corresponding 
5 chat session transcript is generated for that IM chat session. Similar to the generation of 
GUIDs for email messages, a GUED is generated for each chat session transcript. Thus, 
regardless of whether an email message is generated or whether a chat session is initiated, 
each message or transcript is associated with a GUID. Additionally, when a child IM 
chat session is established or launched from a parent email window, a pointer to the 

10 GUID of the child IM chat session is created in the parent email message, thereby linking 
the child IM chat session to the parent email message. Similarly, a pointer to the GUID 
of the parent email message is created in the child IM chat session, thereby linking the 
child IM chat session to the parent email message. 

Each of the email messages or chat transcripts are stored in the thread history 

15 database 1610, along with its GUID, in a tree structure. As shown in FIG. 16, each email 
message is displayed with an email icon 1620, while each EVt chat transcript is displayed 
with an IM icon 1630, thereby distinguishing email threads from chat threads. 

In operation, when a user selects one of the email messages in the thread history, 
the selected email message is displayed to the user in an email read window 412. The 

20 email read window 412 also includes the pointer to the parent email message (or parent 
IM chat session) so that the user may track the history of the message. Similarly, the 
email read window 412 includes the pointer to any child email message (or child IM chat 
session) so that the user may track subsequent email messages (or subsequent IM chat 
sessions) that were launched from the displayed email message. 
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Likewise, when the user selects one of the IM chat sessions in the thread history, a 
transcript of the selected IM chat session is displayed to the user in an IM chat window 
614. The EM chat window 614 also includes a pointer to the parent email message (or 
parent IM chat session) so that the user may track the history of the IM chat session. 
5 Similarly, the IM chat window 614 includes the pointer to any child email message (or 
child IM chat session) so that the user may track subsequent email messages (or 
subsequent IM chat sessions) that were launched from the displayed IM chat session 
transcript. 

Since storing of thread histories, generally, is known in the art, further discussion 
10 of storing thread histories is omitted here. However, it is worthwhile to note that, unlike 

prior systems, the integration of email and IM as shown in the embodiments of FIGS. 1 

through 15 permits threading of both email and IM messages. 

In another embodiment, the thread history database 1610 permits the user to 

access any related message, whether email-related or IM-related, from the tree-structure. 
15 Thus, for example, if a user wishes to view an IM chat transcript associated with a 

particular email message, then the user may select the IM chat transcript from the thread 

history database 1610 and open the IM chat transcript for viewing. Similarly, if the user 

wishes to view an email message associated with a particular IM chat session, the email 

message may be selected from the thread history database 1610 for viewing by the user. 
20 As shown with reference to FIG. 16, by having a thread history database 1610 

having both EM-related transcripts and email-related messages, a user may track each 

message or transcript according to its respective thread history. 

As shown in FIGS. 1 through 16, several embodiments of systems for integrating 

email and EM services is shown. Various embodiments of the invention, however, may 

25 also be seen as providing methods for integrating email and IM services. Several 
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embodiments of methods for integrating email and IM services is shown with reference to 
FIGS. 17 through 27. 

FIG. 17 is a flowchart showing one embodiment of a method for integrating email 
and IM services in which IM Internet presence information is displayed on an email read 
5 window. As shown in FIG. 1 7, one embodiment of the method begins when an email 
message is received (1720) from a contact. The received (1720) email message has an 
email address of the contact. The received (1720) email message is displayed (1730) to a 
user. Additionally, IM presence information is displayed (1740) on the email message. 
In an example embodiment, the method of FIG. 17 may be performed by the system as 

10 described with reference to FIGS. 1 through 5 and FIGS. 9 and 10A. Thus, in an example 
embodiment, the IM presence information is displayed (1740) adjacent to the email 
address of the contact. In another embodiment, the email message has email addresses of 
multiple contacts to whom the email message was directed. In that embodiment, the IM 
presence information is displayed (1740) on the email message adjacent to each of the 

1 5 contacts' email addresses. 

FIG. 1 8A is a flowchart showing another embodiment of a method for integrating 
email and IM services in which an IM session may be initiated from an email read 
window. As shown in FIG. 18 A, another embodiment of the method begins when an 
email message from a contact is displayed (1820) to the user at an email read window. 

20 The email message includes an email address of the contact. Upon displaying (1820) the 

email message to the user, the system awaits user input. When the user provides the user 

input, the user input is received (1830) at the displayed email message. In response to the 

received (1830) user input, an IM session is initiated (1840) between the user and the 

contact. In another embodiment, the email message includes email addresses of multiple 

25 contacts to whom the email message was directed. In that embodiment, the user input is a 
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selection of one or more of the email addresses of the multiple contacts. Thus, for that 
embodiment, an IM session is initiated (1840) between the user and one or more of the 
multiple contacts. In an example embodiment, the method of FIG. 18A may be 
performed by the systems described with reference to FIGS. 1 through 5 and FIGS. 9 and 
5 10A. 

FIG. 18B is a flowchart showing yet another embodiment of a method for 
integrating email and IM services in which an IM session may be initiated from an email 
read window. As shown in FIG. 18B, another embodiment of the method begins when an 
email message from a sender is displayed (1820) to the user at an email read window. 

10 The email message includes an email address of the sender. Upon displaying (1820) the 
email message to the user, the system determines (1 850) whether or not the sender is 
present online. The presence of the sender, in some embodiments, is determined (1850) 
in accordance with the mechanisms described herein. If the sender is present, then an EM 
session is initiated (1860) between the user (recipient) and the sender. In another 

15 embodiment, if the email message includes email addresses of multiple contacts to whom 
the email message was directed, then the presence of one or more of the multiple contacts 
is determined. Thus, for that embodiment, an IM session is initiated (1860) between the 
user and one or more of the multiple contacts. 

FIGS. 19 and 20 are flowcharts showing another embodiment of a method for 

20 integrating email and IM services in which IM sessions with multiple contacts is 

established at a single IM window. As shown in FIG. 19, a first IM session is established 

(1920) between the user and a first contact at an IM window. Upon establishing (1920) 

the first IM session with the first contact in the IM window, a second IM session is 

established (1930) with a second contact in the same IM window. Once the first IM 

25 session with the first contact is established (1920), the user receives (1940) IM messages 
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from the first contact. The received (1940) IM messages are displayed (1950) to the user 
at the IM window. Similarly, once the second IM session with the second contact is 
established (1930), the user receives (1960) IM messages from the second contact. The 
received (1960) messages are displayed (1970) to the user at the EM window. 
5 When the user types an IM message to the first and second contacts, this IM 

message is received (2020) at the IM window. After receiving (2020) the IM message 
typed by the user, the IM message is conveyed (2030) to the first contact. Similarly, the 
IM message is also conveyed (2040) to the second contact. In an example embodiment, 
the method of FIGS. 19 and 20 may be performed by the systems described in FIGS. 1 

10 through 5 and FIG. 15. 

FIG. 21 is a flowchart showing another embodiment of a method for integrating 
email and IM services in which IM messages from two disparate IM services is bridged 
by the user's IM service. As shown in FIG. 21, an IM message is received (2120) from a 
first contact. The IM message received (2120) from the first contact is transmittedrby the 

1 5 first contact using a first IM protocol. Upon receiving (2120) the IM message, the IM 
message is reformatted (2130) and forwarded (2140) to a second contact. The second 
contact receives the IM message using a second IM protocol. The reformatting (2130) 
and forwarding (2140) of the IM message may be seen, in the aggregate, as a conveying 
(2150) of the IM message to the second contact. In an example embodiment, the method 

20 of FIG. 21 may be performed by the systems described in FIGS. 1 through 5 and FIG. 15. 

FIG. 22 is a flowchart showing, in greater detail, the reformatting (2130) of the 

IM message shown in FIG. 21. As shown in FIG. 22, the reformatting (2130) may be 

seen as comprising the removal (2220) of the user's EM address. Upon removing (2220) 

the user's IM address, the IM address of the first contact is determined (2230). Once the 

25 EM address of the first contact is determined (2230), the message content from the IM 
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message is extracted (2240). The extracted (2240) message content is then concatenated 
(2250) with the determined IM address of the first contact. As shown in the embodiment 
of FIG. 22, by removing the user's IM address from the message, the IM message is 
forwarded to the recipient as if it were directly sent to the recipient, rather than being 
5 cascaded through the user's system. 

FIG. 23 is a flowchart showing, in greater detail, the removing (2220) of the user 
IM address shown in FIG. 22. The removing (2220) of the user's IM address may be seen 
as a two-step process. Thus, as shown in FIG. 23, the removing (2220) of the user's IM 
address begins with determining (2320) a number of characters in the user's IM address. 
10 Upon determining (2320) the number of characters in the user's IM address, the same 

number of delete characters is inserted (2330) adjacent to the user's IM address. Thus, in 
effect, the inserted delete characters removes the user's IM address from the message 
stream. 

FIG. 24 is a flowchart showing one embodiment of a method for integrating email 
15 and IM services in which contact information is correlated to a contact identifier 
associated with a particular contact. As shown in FIG. 24, one embodiment of the 
method begins with receiving (2420) of contact information. Upon receiving (2420) the 
contact information, the received (2420) contact information is correlated (2430) to a 
contact identifier. As described with reference to FIGS. 12 through 13B, the contact 
20 information may comprise a full name, one or more email addresses, one or more IM 

addresses, one or more phone numbers, one or more mailing addresses, and other detailed 
information related to the contact. 

FIGS. 25 through 27 are flowcharts showing several embodiments of methods for 

integrating email and IM services in which email thread history and IM thread history are 

25 stored in a single thread history database. As shown in FIG. 25, one embodiment may be 
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seen as comprising the generating (2520) of an email message from an IM session 
window. In addition to generating (2520) the email message from the IM session 
window, a globally unique identifier (GUID) associated with the generated email message 
is also generated (2530). Both the email message and the GUID are then stored (2540) in 
5 a message thread history database. Similarly, as shown in FIG. 26, when an email 

message is received (2620), a GUID associated with the received (2620) email message is 
generated (2630). The received (2620) email and the generated (2630) GUID are stored 
(2640) in the message thread history database. Also, when an IM session is initiated 
(2720) from an email read window, a session transcript is generated (2730). In addition 

10 to the session transcript, a GUID associated with the session transcript is also generated 
(2740). The IM session transcript and the GUID are stored (2750) in the thread history • 
database. Thus, as shown in FIGS. 25 through 27, both IM and email thread histories 
may be stored in a single thread history database, thereby permitting a user to access any 
IM transcript or email message associated with a particular thread. In an example 

15 embodiment, the thread history database may be similar to the database shown in FIG. 16. 
FIGS. 28A through 28E are data flow diagrams corresponding to FIGS. 2A 
through 2C. In this regard, FIGS. 28A through 28E show the data flow subsequent to 
installation of software components. As shown in FIG. 28 A, the tray manager 102 
receives (2902) a selection of an email user interface 210 by the user. Upon receiving the 

20 selection of the email user interface 210, the tray manager 102 requests (2804) login 

names and passwords for all of the user's email and IM accounts from the login database 

3050. The login names and passwords for all of the user's email and IM accounts is 

received (2806) by the tray manager 102 in response to the request (2804). The email 

login names and passwords are then conveyed (2808) by the tray manager 102 to the 

25 email user agent 106, which logs into (2810) each of the user's email accounts using the 
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email login names and passwords. Upon logging into (2810) each of the user's email 
accounts, the email user agent 106 requests (2812) email messages from the email server 
204. In response to the request (2812), the email user agent 106 receives (2814) the email 
messages from the email server 204. The process of retrieving email messages is 
5 described in greater detail with reference to FIGS. 30 and 31 and is, therefore, not 

discussed further here. Upon receiving (2814) the email messages, the email user agent 
106 stores conveys the email messages to a mail store 206 for storing (2816). 

In addition to retrieving email messages, a user interface is instantiated to display 
the retrieved email messages. This process is shown in FIG. 28B. As shown in FIG. 

10 28B, the email user agent 104 generates a command to instantiate a user interface. The 
command is conveyed (2818) to the tray manager 102, which instantiates (2820) the 
email user interface 210. The email user interface 210 further instantiates (2822) a 
message center. Upon instantiating (2820) the email user interface 210 and the message 
center, the email user agent 106 issues a request (2824) to the mail store 206 for all of the 

15 stored email messages. The email messages are received (2826) by the email user agent 
106 in response to the request. The email user agent 106 conveys (2828) the email 
messages to the tray manager 102, which, in turn, conveys (2830) the email messages to 
the email user interface 210 for display. 

As shown in FIG. 28C, in a substantially parallel process as the retrieval of the 

20 email messages, the tray manager 102 conveys (2832) the IM login names and passwords 
to the IM user agent 104. The IM user agent 104 logs into (2834) each of the user's IM 
accounts using the received, EM login names and passwords. Upon logging into (2834) 
each of the IM accounts, the EM user agent obtains (2836) the EM Internet presence 
information for each of the EM contacts as described in U.S. provisional patent 
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application serial numbers 60/41 1,336 and 60/419,613, and U.S. patent application serial 
numbers 10/274,408, 10/274,478, and 10/274,405. 

Thus, as shown in FIGS. 28A through 28C, if the user chooses to launch the email 
user interface 210, then all of the user's email messages from all of the user's email 
5 accounts is displayed to the user by launching the tray manager 1 02. Additionally, all of 
the user's contacts' IM Internet presence information is retrieved by the launching of the 
tray manager 102. 

FIGS. 29A through 29E are data flow diagrams corresponding to FIGS. 3A 
through 3C. In this regard, FIGS. 29 A through 29E show the data flow subsequent to 

10 installation of software components. As shown in FIG. 29 A, the tray manager 102 
receives (2902) the selection of the IM user interface. Upon receiving (2902) the 
selection, the tray manager 102 instantiates (2904) the EM user interface 308. The IM 
user interface 308 queries (2906) the user for a login name and password. Thus, unlike 
the selection of the email user interface 210 in FIGS. 28 A through 28C, the selection of 

15 the IM user interface 308, in this embodiment, results in user input of a login name and 
password. The IM user interface 308 receives (2908) the login name and password 
entered by the user and conveys (2910) the login name and password to the IM user agent 
104. The IM user agent 104 looks up (2912) the login database 3050 to determine 
whether or the login name and password are in the login database 3050. If the login name 

20 and password are in the login database 3050, then the IM user agent 104 receives (2914) a 
confirmation that the login name and password are valid. Upon receiving the 
confirmation, the IM user agent 104 issues a request (2916) to the login database 3050 for 
all IM login names and passwords. The IM login names and passwords are received 
(2918) in response to the request (2916). 
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As shown in FIG. 29B, upon receiving (2918) all of the IM login names and 
passwords, the IM user agent logs into (2920) each of the user's IM accounts through the 
IM server 304 using the IM login names and passwords. Since the login process is 
discussed in detail in U.S. provisional patent application serial numbers 60/41 1,336 and 
5 60/419,613, and U.S. patent application serial numbers 10/274,408, 10/274,478, and 
10/274,405, further discussion of the login process is omitted here. Upon logging into 
(2920) the IM accounts through the IM server 304, the IM user agent 104 obtains (2922) 
the IM Internet presence information for each of the user's contacts from the IM server 
304. Upon obtaining (2922) the IM Internet presence information, the IM user agent 104 

1 0 issues (2924) a command to the tray manager 102 to display the IM Internet presence 
information for all of the user's contacts. In response to the command, the tray manager 
102 issues a request (2926) to the IM user interface 308 to instantiate a roster window. 
The IM user interface 308 instantiates (2928) the roster window in response to the issued 
request by the tray manager 102. Upon instantiation (2928) of the roster window, the IM 

15 user agent 104 conveys (2930) the IM Internet presence information to the tray manager 
102, which, in turn, conveys (2932) the IM Internet presence information to the roster 
window through the IM user interface 308. The IM Internet presence information is 
subsequently displayed to the user at the roster window. 

As shown in FIG. 29C, in a substantially parallel process as the retrieval of the IM 

20 Internet presence information, the IM user agent 104 conveys (2934) the login name and 

password to the tray manager 102, which, in turn, conveys (2936) the login name and 

password to the email user agent 106. The email user agent 106 issues (2942) a request to 

the login database 3050 for all of the email login names and passwords for all of the user's 

email accounts. In response to the request (2942), the email user agent 106 receives 

25 (2944) the email login names and passwords from the login database 3050. 
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Continuing with FIG. 29D, the email user agent 106 logs into (2946) each of the 
user's email accounts using the email login names and passwords. The process of logging 
into each of the user's email accounts is shown in greater detail with reference to FIGS. 
30 and 31. Upon logging into (2946) each of the email accounts, the email user agent 106 
5 issues a request (2948) for all of the email messages at the various email accounts. The 
email messages are received (2950) by the email user agent 106 in response to the request 
(2948). Upon receiving (2950) the email messages, the email user agent 106 conveys the 
email messages to the mail store 206, which stores (2952) the email messages. 

Thus, as shown in FIGS. 29A through 29D, if the user chooses to launch the IM 

10 user interface 308, all of the user's contacts' IM Internet presence information is retrieved 
and displayed to the user by inputting a single user name and password. Additionally, all 
of the user's email messages from all of the user's email accounts is retrieved by the 
inputting of the single user name and password. 

FIGS. 30 and 31 show an example email login process in which a specific user 

15 may log into several email accounts to retrieve email messages. In this regard, FIGS. 30 
and 31 show email components that correspond to the IM components shown in U.S. 
provisional patent application serial numbers 60/41 1,336 and 60/419,613, and U.S. patent 
application serial numbers 10/274,408, 10/274,478, and 10/274,405. While the 
embodiments of FIGS. 30 and 31 refer to specific Internet service providers (e.g.,, Yahoo, 

20 Microsoft Network (MSN), America On-Line (AOL), BellSouth, etc.), it should be 

understood that these specific references are provided for purposes of clarity, and are not 

intended to limit the invention to the specifically provided examples. Since similar 

transport mechanisms are described in U.S. provisional patent application serial numbers 

60/41 1,336 and 60/419,613, and U.S. patent application serial numbers 10/274,408, 

25 10/274,478, and 10/274,405, only a truncated discussion of email transport mechanisms is 
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presented with reference to FIGS. 30 and 31 . 

As shown in an example embodiment in FIG. 30, after a setup process, a tray 
manager 102 accesses a login database 3050 to retrieve login names and passwords for 
each email account belonging to a user. The example of FIG. 30 shows the user as 
5 having post office protocol version 3 (POP3) email accounts on AOL, Yahoo, MSN, and 
BellSouth. Since POP3 is known in the art, further discussion of POP3 is omitted here. 
Upon retrieving the login names and passwords, the tray manager 102 generates a request 
to the email user agent 106, which includes information for instantiating one or more 
transport protocol objects (TPOs). Each of the TPOs is configured to provide an interface 

10 to each of the user's POP3 email accounts. Thus, in response to the request, the email 

user agent 106 instantiates POP3 TPOs 3030, 3032, 3034, 3036 for the user's AOL email 
account, Yahoo email account, MSN email account, and BellSouth email account. Other 
embodiments may include transport mechanisms launched or activated in other manners. 
FIG. 31 is a block diagram showing one embodiment in which instantiated POP3 

15 TPOs 3030, 3032, 3034, 3036 log into their respective email servers 3110, 3112, 31 14, 
3126 to retrieve email messages from the various email servers 3110, 3112, 3114, 3126. 
Upon being instantiated, each of the POP3 TPOs 3030, 3032, 3034, 3036 receives the 
login names and passwords for their respective email server 31 10, 31 12, 31 14, 3126, 
thereby permitting the POP3 TPOs 3030, 3032, 3034, 3036 to log into the user's email 

20 accounts at their respective servers 3 1 1 0, 3 1 1 2, 3 1 1 4, 3 126. Upon logging into each of 

the email accounts at the various email servers 31 10, 31 12, 31 14, 3126, each of the POP3 

TPOs 3030, 3032, 3034, 3036 retrieves email messages from its respective server 3110, 

3 1 12, 31 14, 3126. In this regard, for example, the AOL POP3 TPO 3030 retrieves email 

messages from the AOL server 31 10; the Yahoo POP3 TPO 3032 retrieves email 

25 messages from the Yahoo server 3112, etc. The retrieved email messages are conveyed 
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to the tray manager 102, which, in turn, conveys the email messages to the email user 
agent 106. Since the email messages are directed through different POP3 TPOs 3030, 
3032, 3034, 3036, each email message may be sorted by the email user agent 106 
according to its originating email account (e.g., AOL email account, Yahoo email 
5 account, MSN email account, BellSouth email account, etc.). Consequently, when the 
user chooses to reply to a received email message, the email user agent 106, in one 
embodiment, may direct the reply email message through the same POP3 TPO through 
which the email message was received. In other words, the reply to an email message 
uses the same email account from which the email message was received. Thus, for 

10 example, if the email user agent 106 receives an email message through the user's AOL 
email account, then the reply to that email message, in one embodiment, would be' 
directed to the recipient through the user's AOL account. Similarly, if an email message 
is received through the user's BellSouth email account, then the reply to that email 
message would be directed to the recipient through the user's BellSouth email account. 

1 5 The address book object 108, the email user agent 106, the IM user agent 104, the 

tray manager 102, and other objects instantiated by these components may be 
implemented in hardware, software, firmware, or a combination thereof. In the preferred 
embodiment(s), the address book object 108, the email user agent 106, the IM user agent 
104, the tray manager 102, and other objects instantiated by these components is 

20 implemented in software or firmware that is stored in a memory and that is executed by a 

suitable instruction execution system. If implemented in hardware, as in an alternative 

embodiment, the address book object 108, the email user agent 106, the IM user agent 

104, the tray manager 102, and other objects instantiated by these components can be 

implemented with any or a combination of the following technologies, which are all well 

25 known in the art: a discrete logic circuit(s) having logic gates for implementing logic 
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functions upon data signals, an application specific integrated circuit (ASIC) having 
appropriate combinational logic gates, a programmable gate array(s) (PGA), a field 
programmable gate array (FPGA), etc. 

Any process descriptions or blocks in flow charts should be understood as 
representing modules, segments, or portions of code which include one or more 
executable instructions for implementing specific logical functions or steps in the process, 
and alternate implementations are included within the scope of the preferred embodiment 
of the present invention in which functions may be executed out of order from that shown 
or discussed, including substantially concurrently or in reverse order, depending on the 
functionality involved, as would be understood by those reasonably skilled in the art of 
the present invention. 

The address book object 108, the email user agent 106, the IM user agent 104, the 

tray manager 102, and other objects instantiated by these components may be 

implemented as a computer program, which comprises an ordered listing of executable 

instructions for implementing logical functions. As such the address book object 108, the 

email user agent 106, the IM user agent 104, the tray manager 102, the address book 

database 110, and other objects instantiated by these components can be embodied in any 

computer-readable medium for use by or in connection with an instruction execution 

system, apparatus, or device, such as a computer-based system, processor-containing 

system, or other system that can fetch the instructions from the instruction execution 

system, apparatus, or device and execute the instructions. In the context of this 

document, a "computer-readable medium" can be any means that can contain, store, 

communicate, propagate, or transport the program for use by or in connection with the 

instruction execution system, apparatus, or device. The computer-readable medium can 

be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, 
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infrared, or semiconductor system, apparatus, device, or propagation medium. More 
specific examples (a nonexhaustive list) of the computer-readable medium would include 
the following: an electrical connection (electronic) having one or more wires, a portable 
computer diskette (magnetic), a random access memory (RAM) (electronic), a read-only 
5 memory (ROM) (electronic), an erasable programmable read-only memory (EPROM or 
Flash memory) (electronic), an optical fiber (optical), and a portable compact disc read- 
only memory (CDROM) (optical). Note that the computer-readable medium could even 
be paper or another suitable medium upon which the program is printed, as the program 
can be electronically captured via, for instance, optical scanning of the paper or other 

10 medium, then compiled, interpreted or otherwise processed in a suitable manner if 
necessary, and then stored in a computer memory. 

Although exemplary embodiments have been shown and described, it will be clear 
to those of ordinary skill in the art that a number of changes, modifications, or alterations 
to the invention as described may be made. For example, while the disclosed 

15 embodiments show the various modules (e.g., address book object 108, the email user 
agent 106, the IM user agent 104, the tray manager 102, other objects instantiated by 
these components, etc.) as being in a distributed network, it will be clear to one of 
ordinary skill in the art that the various modules may be located on a server or a client 
without adverse effect to the functioning of the various components. All such changes, 

20 modifications, and alterations should therefore be seen as within the scope of the 
disclosure. 
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